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BACKGROUND OF THE INVENTION 

Field of Invention 

The present invention pertains to the field of 
decision analysis. More particularly, this invention 
relates to modeling decision-maker preferences. 

Art Backcrround 

A variety of problems commonly involve making 
choices among available alternatives. Such choices 
usually involve tradeoffs among the available 
alternatives. For example, an alternative may be better 
in terms of one dimension such as speed, privacy, or 
purchase price, etc and worse in terms of another 
dimension such as footprint, recency of data, or 
proximity to customers, etc. An analysis of a choice 
among available alternatives commonly involves an 
analysis of tradeoffs along many different dimensions. 

Prior techniques for making choices among available 
alternatives commonly involve a determination of an 
optimal linear weighting for the values of the various 
dimensions. Unfortunately, it is often not clear how to 
optimize with respect to any given dimension. In 
addition, it is often the case that the desirability of 
an alternative is contingent on a combination of several 
different dimensions. As a consequence, the 
determination of an optimal choice among the available 
alternatives is typically a major activity that is 
generally reserved for major decisions which are made 
infrequently . 
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Prior techniques for making choices among available 
alternatives may involve eliciting a quantitative 
estimate from decision-makers as to the relative 
importance of different dimensions. Unfortunately, 
5 decision-makers are typically not proficient at 

assigning such quantitative estimates. For example, it 
is usually not clear to a decision-maker whether the 
cost of an alternative is twice, or three times, etc., 
as important as the throughput yielded by the 
10 alternative. As a consequence, prior techniques which 
take into account such quantitative estimates are 
subject to errors. 

s ?^ 

ui 
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SUMMARY OF THE INVENTION 

Techniques are disclosed for modeling the 
preferences of a decision-maker using sampled pair-wise 
5 preferences. These techniques involve identifying a set 
of alternatives to be presented to the decision-maker 
and identifying a set of attributes associated with the 
alternatives. The alternatives are each characterized 
by a set of values for the attributes. A sample set of 
10 pair-wise preferences among a subset of the alternatives 
is obtained and a model of preferences is generated by 
p iteratively generating a set of candidate models and 

f£ evaluating the candidate models using a fitness measure 

y 0 

^ which is based on the sample set of pair-wise 

=P 15 preferences. The models may take into account 

iJ characterization attributes associated with potential 

M= decision-makers. For example, the decision maker 14 has 

^ an associated set of characterization attributes 60-62. 

J=: 2 0 The preference models yielded by these techniques 

A may be used in a wide variety of systems and devices to 

Q render choices among available alternatives while 

automatically taking into account the modeled 
preferences of the relevant decision makers. Such 
25 systems include presentation systems including those 
used in business and e-commerce as well and product 
support systems, software distribution systems, web 
server systems including e-commerce web servers. In 
addition, preference models yielded by these techniques 
3 0 may be used in systems and devices which render such 

choices on behalf of particular decision-makers. Such 
systems include web agents and may include hand-held 
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devices and/or mechanisms implemented in software on 
computer systems . 

Other features and advantages of the present 
invention will be apparent from the detailed description 
that follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is described with respect to 
particular exemplary embodiments thereof and reference 
5 is accordingly made to the drawings in which: 

Figure 1 shows a system for generating a preference 
model according to the present techniques; 

Figure 2 shows steps involved in generating a 
preference model from sample pair-wise preferences; 

Figure 3 shows steps involved in evolving a 
preference model using genetic programming techniques; 

Figure 4 shows steps involved in constructing a new 

population of candidate models from the current 
population of candidate models; 

Figure 5a- 5c show a new candidate model which is 

generated by combining a pair of candidate models of a 
current population . 



LP 
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DETAILED DESCRIPTION 



Figure 1 shows a system 10 for generating a 

preference model 12 according to the present techniques. 
The preference model 12 is a model of the preferences of 
a decision-maker 14 with respect to a set of 
alternatives 20-22. The alternatives 20-22 have 
corresponding sets of attributes 30-32, 40-42, and 50- 
52, respectively. The alternatives 20-22 differ by the 
values vl-v3, v4-v6, and v7-v9 assigned to the 
attributes 30-32, 40-42, and 50-52, respectively. The 
preference model 12 is generated by a modeler 16. The 
modeler 16 takes as input information from the decision- 
maker 14 and/or a set of other decision-makers 18. 

The decision-maker 14 may be a human being or a 
non-human animal. Likewise, the other decision-makers 
18 may be human beings or non-human animals. 

The preference model 12 once generated may be used 
to determine or predict the preferences of the decision- 
maker 14 or groups of decision-makers with respect to 
any combination of the alternatives 2 0-22 or of 
alternatives having similar attributes. Numerous 
applications and uses of the preference model 12 are 
possible . 

For example, the alternatives 2 0-22 may be 
different alternatives of similar available products 
which are characterized by different set of values for 
the attributes of price, brand name, size, packaging, 
etc. In this case, the preference model 12 may be used 
to predict which of the available products the decision- 
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maker 14 is likely to select. This information may be 
used to determine appropriate products to display on 
brick-and-mortar store shelves or e-commerce web pages. 
This information may also be used by a web agent or 
5 device with similar functionality that shops in an 

automatic fashion on behalf of the decision-maker 14. 

In another example, the alternatives 20-22 may be 
different web site designs which are characterized by 

10 different sets of values for the attributes of graphical 
or multimedia content, and/or level of technical 
content, etc. This information may be used by a web 
server to adapt a web browsing experience to the 
preferences of the decision-maker 14 or groups of 

15 decision-makers. 



yi Figure 2 shows a method used in the system 10 to 

^ generate the preference model 12. At step 70, a set of 

□ alternatives for which the preferences of the decision- 

's; 

£ 20 maker 14 are to be modeled are identified. These are 

represented as the alternatives 20-22. The number and 

O nature of the alternatives 2 0-22 are generally 

application specific. The alternatives 20-22 may be 
products, services, web page and/or web site designs, 
25 store front designs, store shelf arrangements, facility 
site selections, foods, food types, movies, plays, 
music, or anything that may be conceivably be subject to 
choices or preferences associated with the decision- 
maker 14 . 



At step 72, a set of attributes for the 
alternatives 20-22 are identified. These are 
represented as the attributes 30-32, 40-42, and 50-52, 
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respectively. Again, the number and nature of the 
attributes 30-32, 40-42, and 50-52 are generally 
application-specific. For example, products may have 
price, size, brand name, etc. attributes, movies may 
have price, genre, MPAA rating, etc. attributes, and web 
page designs may have types of products, price range for 
products, etc. attributes. 

At step 74, the alternatives 20-22 are 
characterized by obtaining a set of values for the 
corresponding attributes 30-32, 40-42, and 50-52. These 
are the values vl-v3, v4-v6, and v7-v9 shown and may be 
obtained in a variety of ways. For example, the values 
may be randomly generated over an appropriate space. 
Producers or distributors may provide price, size 
values, etc. for attributes associated with products. A 
web designer may provide values for the attributes of 
web pages and web sites. Professional critics may 
provide values for the attributes associated with movies 
or plays. In addition, values for attributes may be 
obtained by observation. 

At step 76, a sample set of pair-wise preferences 
among the alternatives 2 0-22 is obtained. The sample 
set of pair-wise preferences may be obtained from the 
decision-maker 14 or the other decision-makers 18 or any 
combination of the decision-maker 14 and the other 
decision-makers 18. The pair-wise preferences may be 
obtained by common agreement among the involved 
decision-makers. The agreement may be obtained by 
polling the involved decision-makers. 
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The alternatives 20-22 may be realized alternatives 
and a relative preference between two successive 
realized alternatives experienced by the appropriate 
decision-maker may be obtained at step 76. 

5 

Alternatively, the appropriate decision-maker may 
be presented with the alternatives at step 76 and a 
behavior of the decision-maker in response to the 
alternatives may be observed to obtain the sample set of 
10 pair-wise preferences. 



For example, the decision-maker 14 may prefer the 
Q alternative 21 over the alternative 22 and may prefer 

■'S the alternative 2 0 over the alternative 22 and may 

yi 

£ 15 prefer the alternative 21 over the alternative 20. This 

=P may be expressed as the following (example sample set of 

SI 

lr| pair-wiser preferences) : 

B>C 
A>C 

O 20 B>A 

O where A is the alternative 20, B is the alternative 21, 

and C is the alternative 22. This may be viewed as B 
having greater utility than, A having greater utility 
2 5 than C, and B having greater utility than A. 

The sample set of pair-wise preferences may be 
obtained by presenting the alternatives in actual or 
graphical or textual description form to the decision- 
30 maker 14 and obtaining from the decision-maker 14 a 
ranking of the alternatives. 

At step 78, the preference model 12 is evolved 
using a fitness measure which is based on the sample set 
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-lo- 
ot pair-wise preferences obtained at step 76. Step 78 
in one embodiment is performed using genetic programming 
techniques . 



5 Figure 3 shows steps involved in evolving the 

preference model 12 using genetic programming techniques 
in one embodiment. At step 80, a population of the 
candidate models is constructed. Each candidate model 
is capable of expressing a modeled pair-wise preference 
10 between any two of the alternatives 2 0-22 in response to 
the corresponding values vl-v3, v4-v6, and v7-v9 
assigned to the corresponding attributes, 30-32, 40-42, 
and 50-52 . 

15 The candidate models may be computer programs. The 

computer programs may each be represented as a tree or 
as a sequence of computer instructions or in any other 
manner that may be used to represent computer programs . 
Alternatively, the candidate models may be mathematical 
^ 2 0 expressions each represented as a tree. In other 

G alternatives, the candidate models are neural networks 

O or belief networks. 

.ss=. 

In one embodiment, the candidate models express a 
25 modeled pair-wise preference by returning a number 

representing a utility value for each alternative. An 
example candidate model may return the following 
(example utility values) for alternatives A, B, and C: 
A=0 . 5 

30 B=0.4 
C=0 . 01 

At step 82, the candidate models from the 
population are evaluated using a fitness measure that 
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penalizes the candidate models for disagreeing with the 
sample set of pair-wise preferences obtained at step 76. 
The candidate models from the population are evaluated 
by examining the modeled pair-wise preferences of each 
candidate model over a subset of the alternatives 20-22 
and deriving a fitness measure which includes at least 
one criterion that penalizes a candidate model when the 
modeled pair-wise preferences it yields disagree with 
the sample set of pair-wise preferences. 

The criterion that penalizes a candidate model may 
be based on a number of the sample set of pair-wise 
preferences obtained at step 76 that disagree with the 
modeled pair-wise preferences yielded by the candidate 
model. The example utility values A=0.5, B=0.4, C=0.01 
correspond to the example modeled pair-wise preferences 
A>B, A>C, and B>C. The candidate model that generated 
the example modeled pair-wise preferences is penalized 
by one for not agreeing with the preference B>A in the 
example sample set of pair-wise preferences shown above. 

In some embodiments, the sample set of pair-wise 
preferences are obtained with an indication of 
preference strength. In such embodiments, the penalty 
for disagreeing with the sample set of pair-wise 
preferences is based on the indications of preference 
strength. 

At step 84, the population of candidate models is 
examined for a candidate model whose fitness measure 
meets a termination criterion. The termination criteria 
may be based on any determination on what is a good 
enough candidate model to be used as the preference 
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model 12 . The accuracy to which the selected candidate 
model agrees with the sample set of pair-wise 
preferences is freely selectable. 

The step of evolving (step 78) continues by 
constructing a new population of candidate models and 
repeating steps 80-84 for the new population. This loop 
of constructing new populations and repeating steps 80- 
84 for each new population continues until a candidate 
model is found that meets the termination criterion. 

Figure 4 shows the steps involved in constructing a 

new population of candidate models from a current 
population of candidate models. At step 90, a subset of 
the candidate models from the current population is 
selected based on the fitness measures. For example, 
the subset of candidate models having fitness measures 
that agree most closely with the sample set of pair-wise 
preferences may be selected at step 90. At step 92, a 
set of candidate models for a new population is 
generated by combining portions the candidate models 
selected at step 92 . The selected candidate models may 
be combined using operations which are modeled on the 
genetic operations of mutation and/or cross-oyer. 

Figure 5a- 5c show a new candidate model 12 0 which 

is generated by combining a pair of candidate models 100 
and 110 of a current population. In this example, the 
candidate models 100 and 110 each provide a tree 
arrangement of nodes that represents a mathematical 
function involving variables x, y, and z. The variables 
X, y, and z represent values for the attributes 
associated with the alternatives 20-22. 
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The candidate model 100 includes an arrangement of 
operator nodes 200-204 and input nodes 210-215. The 
operator nodes 200-204 specify add, multiply, subtract, 
subtract, and multiply operators, respectively. The 
5 input nodes 210-215 specify x, x, z, y, a constant value 
equal to 3, and x inputs, respectively. The candidate 
model 100 provides a tree representation of the 
mathematical function f (x, y , z) =x^+3xy- z . The candidate 
model 110 includes an arrangement of operator nodes 300- 
10 3 06 and input nodes 310-317 that represents the 

mathematical function f (x, y , z) = (x+z+y) (y-z) (32y+4) . 

The new candidate model 120 is formed by cutting 
the operator nodes 300, 302, and 304-306 and the input 
15 nodes 313-317 from the candidate model 110 and combining 
them with the operators nodes 2 02-204 and input nodes 
212-215 which are cut from the candidate model 100. The 
new candidate model 12 0 represents the mathematical 
function f (x, y , z) = (3xy- z) (y-z) (32y+4) . 

20 

In an alternative embodiment, the preference model 
12 may take into account characteristics associated with 
decision-makers, A method in the system 10 for 
generating the preference model 12 in the alternative 

25 embodiment includes a step of identifying a set of 

characterization attributes that may be associated with 
the decision-maker 14 and a step of obtaining a sample 
set of values for the characterization attributes from 
the decision-makers from which the sample set of pair- 

30 wise preferences are obtained at step 76. The step of 
obtaining the sample values for the characterization 
attributes may be performed using a set of multiple 
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choice questions which are presented to the appropriate 
decision-makers . 

The step 80 of constructing a population of 
5 candidate models in the alternative embodiment involves 
constructing candidate model each capable of expressing 
a modeled pair-wise preference between any two of the 
alternatives in response to the values for the 
attributes as well as the values for the 
10 characterization attributes. For example, candidate 
models which are mathematical functions such as those 
described above are functions of cl, c2 , through cn as 
D well as x,y, and z, i.e. f(x,y,z,cl, c2...cn) in the 

I alternative embodiment. 

i 15 

^ The step 82 of evaluating the candidate models in 

yi the alternative embodiment involve examining the modeled 

pair-wise preferences of each candidate model over a 
^ subset of the alternatives and decision-makers and 

=C 20 deriving a fitness measure which includes at least one 

criterion that penalizes the candidate models for 
disagreeing with the combination of the sample set of 
pair-wise preferences and corresponding sample values 
for the characterization attributes. 

25 

A system 10 may be incorporated into a system for 
designing a presentation. This enables design of the 
presentation by selecting between available 
alternatives. In such systems, the preference model 12 
30 is constructed for a particular target audience using 
the techniques described herein. 
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The presentation may be customized for a specific 
member of the target audience. For example, the 
specific member of the target audience is characterized 
by values for the characterization attributes described 
5 above. Alternatively, the presentation may be designed 
to appeal to the target audience as a whole by 
considering the expected average preference of the 
members of the audience. 

10 An example of a presentation is a web page. 

Another example of a presentation is an advertisement. 
Another example of a presentation is a direct -marketing 
O solicitation. Still another example of a presentation 

J is a product or service offered for sale and the 

15 alternatives involve selection among feature 

combinations, ingredients, compositions, configurations, 
m and/or packaging. Another example of a presentation is 

^ the establishment of the price of a product or service 

Q offered for sale. Yet another example of a presentation 

^ 20 is a shelf layout or display in a store. 

O 

O Another example of a presentation is a set of one 

™ or more products or services offered for sale. This 

includes a presentation of a single product or a single 
25 service as well as a presentation of a bundle of 

products or a bundle of services. The presentation of a 
product or a bundle of products or a service or a bundle 
of services may include price, composition, packaging 
and/or other characteristics of the products or services 
30 offered for sale. 



Yet another example of a presentation is a sequence 
of questions or actions. The sequence may be steps to 
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diagnose a problem. Examples of problem diagnosis are 
numerous and include software and hardware problem 
diagnosis as well as problem diagnosis in mechanical or 
other systems as well as behaviors. Examples of a step 
5 used in diagnosing a problem include a question, an 
action, a measurement, etc. 

The present techniques enable a diagnostic system 
to adapt its presentation of questions, actions, 
10 measurements, etc., to the modeled preferences of a 

user. For example, some users may prefer technically 
oriented questions while others may not. As another 
p example, different users tend to have different levels 

of knowledge of the system being diagnosed and different 
If 15 preferences on the technical content of questions. Some 

users may prefer visually oriented diagnostic steps 

SJ 

= while others may prefer text oriented questions. 

y ^ 

L The sequence of steps may be probabilistically 

U 

^ 20 weighted based on the likelihood of specific results of 

^ the steps in the sequence. The penalties are weighted 

^ accordingly. 

The modeler 16 or system for designing a 
25 presentation which is based on the modeler 16 may be 

embodied as a physical device. The device may include 
processing means for performing the above described 
method steps and input means such as a keypad, touch- 
pad, voice input or any conceivable input mechanism. 
3 0 The input means allows a user to enter the observable 
attributes of the alternatives into the device. 
Alternatively, the observable attributes of the 
alternatives may obtained by physical measurements 
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carried out by the device. The means in the device for 
obtaining physical measurements may be any conceivable 
measurement means such as bar-code readers, temperature 
sensors, or other types of sensors, etc. The device may 
5 include any type of storage means such as memory for 
storing the preference model 12 . 

The modeler 16 or system for designing a 
presentation which is based on the modeler 16 may be 

10 embodied as a computer program or as a web-based service 
executing on one or more computer systems, possibly 
networked, or other types of devices with processing 
resources. The alternatives 2 0-22 may represent one or 
more products or services offered for sale by one or 

15 more suppliers. The products or services may be offered 
for sale over a computer network. The alternatives 20- 
22 may represent taking or not taking an action. The 
action may be the installation of software on a computer 
system. 

20 

The alternatives 2 0-22 may represent ways of 
customizing a product or service. The product or 
service may a computer program. The product or service 
may be obtained over a computer network. The 
25 customization options may reflect different available 
degrees of quality of service including, for example, 
price, security, privacy, reliability etc., as well as 
performance , 

3 0 The foregoing detailed description of the present 

invention is provided for the purposes of illustration 
and is not intended to be exhaustive or to limit the 
invention to the precise embodiment disclosed. 
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Accordingly, the scope of the present invention is 
defined by the appended claims. 
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